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METHOD AND APPARATUS FOR AN INTUITIVE 
UNIVERSAL REMOTE CONTROL SYSTEM 



BACKGROUND OF THF TNVFNTf niv 

The present invention relates to aremote control system for remotely 
5 controlling various electronic devices such as television and audio visual ("AY") 
systems using a single remote control. 

In recent years, various electronic devices such as stereo systems, 
television receivers, cassette tape decks, video tape decks, compact disc players, 
laser vision disc players, and the like are equipped with remote control systems. 

I" a conventional system, a remote control system having a 
transmitter is usually positioned remotely from a controlled device. The 
transmitter, when operated, transmits a remote control signal, such as an infrared 
remote control signal, which is received by a receiver in the controlled device. The 
received remote control signal is decoded to control the device as intended by the 
1 5 remote control signal. 

In a universal remote control system, one single remote control is 
capable of controlling more than one AV device. In one type of the universal 
remote control, the remote control comprises a remote memory storing all the 
coding signals for different brands of the AV devices. Then the user programs the 

20 remote control by entering a set of preassigned codes to call up the appropriate 
coding of each device. In another type of the universal remote control, the user 
activates a learning mode of die remote control and lines up the universal remote 
control with the selected device. Then die remote control sequentially tests each 
control signal until the correct one is found. When the correct control signal is 

25 found, the device will signal the user to stop further testing and the corresponding 
control protocol is then stored. 
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SUMMARY OF THE INVENTION 
It is an object of the present invention to provide a novel universal 
remote control system. 

It is another object of the present invention to provide a remote 
control system having a bidirectional communication channel between the remote 
control and the audio video device(s) controlled by the remote control. 

It is another object of the present invention to provide a remote 
control system having a dual communication mode for communication between the 
remote control and the audio video device(s) controlled by the remote control. 
Specifically, the remote control system acconmiodates both infrared communication 
and radio frequency conunimication. 

It is another object of the present mvention to provide a remote 
control system that is capable of automatically switching between a plurality of 
communication modes. 

It is another object of the present invention to provide a remote 
control system that is enable of storing and updating TV programming guide 
information in a remote control memory. 

It is another object of the present invention to provide a novel user 
interface for the remote control in the remote control system. 

It is another object of the present invention to provide a soft 
graphical user interface ("GUI") to the remote contix>l of the remote control system. 

It is another object of the presrat invention to provide a remote 
control system that allows expansion of the television functions that it controls. 

It is another object of the present invention to provide a novel 
calibration handshake method for communications between the remote control and 
at least one audio/video device. 

It is another object of the present invention to provide a remote 
control that is enable of automatically updating the remote control memory with 
universal remote protocols associated with new home entertainment devices. 
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It is another object of the present invention to provide a lost beacon 
feature for the remote control, wherein the user can activate a beacon signal when 
the remote is misplaced. 

It is another object of the present invention to provide a handwriting 
5 recognition input or voice recognition feature as the user interface for the remote 
control. 

Additional objects, features and advantages of various aspects of the 
present invention will become apparent from the following description of its 
preferred embodiments, which description should be taken in conjunction with the 
1 0 accompanying drawings. 

BRIEF DESCRIPTT ON OF THE PR A WIlvnR 

Figure 1 shows a preferred embodiment of a conceptual diagram of 
a universal remote control system according to the present invention. 

Figure 2 shows a block diagram of a remote control system of a 
1 5 preferred embodiment according to the present invention. 

Figure 3 shows a preferred embodiment of a remote control block 
of the remote control system of Figure 2. 

Figure 4 shows a preferred embodiment of a television block or the 
remote control system of Figure 2. 
20 Figure 5 shows a preferred embodiment of a remote control 

according to the present invention. 

Figures 6a and 6b are flow charts of two preferred methods of 
communication mode selection according to the present invention. 

Figure 7 shows a sequence of square pulses used for mode selection 
25 as shown in the flow chart of Figure 6b. 

Figures 8a,b illustrate how EPG programming data can be used in 
a remote control of a preferred embodiment according to the present invention. 

Figures 9a,b illustrate the soft GUI displayed on a remote control of 
a preferred embodiment according to the present invention. 
30 Figures 10a,b,c,d illustrate the ability to expand the TV functions 

accordmg to the present invention. 



wo 00/59212 PCT/USOO/04407 



4 

Figures 1 la,b illustrate the calibration handshake ability according 
to the present invention. 

DETAILED DKSrRTPTT QN OF THF DP AWTTN^ nfi 

Figure 1 shows a preferred embodiment of a concq)tual diagram of 
5 a universal remote control system according to the present invention. In the 
preferred embodiment as shown, the universal remote control system comprises a 
remote control 110 and a television set 120. In another embodiment not shown, the 
television set can be substituted with a set top box connected to a television set. In 
addition, as in the universal remote control systems available on the market, the 
10 remote control of the present invention can also be used for controlling other AV 
devices such as videocassette recorder ("VCR"), stereo system, and digital versatile 
disc ("DVD") components, etc. By encoding the signals sent out by the remote 
control, the remote control is able to establish communication channel between the 
remote control and the television set or other AV devices. In the preferred 

15 embodiment of the present invention, the communication channel established 
between the remote control and any of the devices connected is a bidirectional 
communication channel so that data and information can be transmitted to and from 
the remote control to each of the components in the remote control system. 

Figure 2 shows a block diagram of a remote control system of a 

20 preferred embodiment according to the present invention. As shown in the figure, 
the system as shown only comprises a remote control block 210 and a television set 
block 220. It should be noted also, as stated in the previous paragraphs, the present 
invention can be applied to other audio/video devices. 

The television set block 220 of the preferred embodiment comprises 

25 a video signal receiver 222 for receivmg and processing radio frequency or 
baseband video data; a memory 224 for storing any information needed for the 
television set and the remote control; an infrared communicator 226 for providing 
a infrared communication with the remote control; and a radio frequency 
communicator 228 for providing a radio frequency communication with the remote 

30 control. In the preferred embodiment as shown, the selection between these two 
communication modes (i.e. infrared and radio frequency) is performed and 
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determined by a proximity sensor 211 and a microcontroller 212 located in the 
remote control block 210 as shown. 

As shown in Figure 2, the remote control block 210 comprises an 
infrared conmmnicator 213 for communicating with the television set; a radio 
5 frequency communicator 214 for communicating with the television set; a 
microcontroller 2 1 2 for controlling the basic functions of the remote control; a user 
interface mechanism 215 for inputting and displaying data; a remote control 
memory 216 for storing information (e.g. programming guide information); a 
proximity sensor 211 connected to the microcontroller 212 for facilitating the 
1 0 microcontroller 2 1 2 to select a communication mode between the remote control 
210 and the television set 220; a remote finder beacon mechanism comprising a 
radio frequency demodulator 218 connected to a remote finder beacon 217 and a 
beeper 219 for receiving beacon signal from the television set 220 for locating the 
remote control 210; a voice recognition mechanism (not shown) for processing 

15 voice commands issued by the user, and a power supply 231 for providing 
rechargeable and non-interruptible power to the remote control. 

In the preferred anbodiment as shown, the microcontroller 212 of 
the remote control controls all major fimctions, such as: (1) handling user 
commands received by the user interface 215, and generates control signals and 

20 transmits the control signals to the television set 220, or any other AV devices by 
one of the two transceivers; (2) processing electronic program guide CTEPG'O data 
received fix>m the television set and storing the EPG data in the remote control 
memory 216; (3) parsmg, retrieving, and displaying the processed EPG data fix>m 
the memory 216 as requested by the user through the use of the user interface 215; 

25 (4) updating the stored EPG data and communication protocol(s) received from the 
television set 220, or any other audio/video devices; (5) selecting the optimal 
communication mode between the infirared communication mode and the radio 
frequency conununication mode in response to the proximity sensor 21 1; and (6) 
analyzing and responding to user commands received torn the user interface 215 

30 and performing the appropriate fimctions, etc. 
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Figure 3 is a block diagram showing additional details of the remote 
control portion of the remote control system according to the present invention. 
The remote control portion as shown comprises a radio frequency transceiver 301 , 
a IRDA transceiver 302 and IRDA encoder/decoder 303 pair supporting IRDA 
5 standard, a DSP microcontroller 304 for controlling different components within 
the remote control block, a pair of bus controllers 305a,305b for controlling data 
transfer within the remote control block, a remote control memory 306 for storing 
the remote control system program and a handwriting recognition program, a non- 
volatile flash memory 307 for storing the EPG data or universal remote contrx)! 
1 0 protocol(s) downloaded from the television set or a set-top box, a touch screen LCD 
device 308 for data and/or command entry, a ringer 309 for producing a beacon or 
activating a flashing LED when a remote control finding signal is received. In 
addition, the remote control also comprises four voltage regulators 
3 1 0a,3 1 Ob,3 1 Oc,3 1 Od. Two of the voltage regulators are used to supply currents to 
1 5 the IRDA encoder/decoder 303 and the IRDA receiver 302, and the remaining two 
voltage regulators are used to supply cuirents to all other components on the remote 
control. In the preferred embodiment as shown, the remote control is powered by 
a rechargeable battery. It should be noted that the IRDA standard is used for the 
infrared communication in this preferred embodiment of the present invention. The 
20 IRDA standard is a cordless data connection standard using infrared light. It is a 
low-cost transceiver signaling technology for two way data exchange. It provides 
high-speed digital exchange through the typical PC UART/serial port at 9600- 
1 15200 bits/s, and in some units compatible high speed extensions up to IMb/s and 
4Mb/s speeds. 

Figure 4 is a block diagram showing additional details of the 
television portion of the remote control according to the present invention. As 
shown in the figure, the television portion comprises a radio firequency transceiver 
401, alRDA transceiver 402 and IRDA encoder/decoder 403 pair supporting IRDA 
standard, a microcontroller 404 for controlling various components withm the 
television portion, aremote control memory 405 for storing aremote control system 
program, a fla^ memory 406 for storing the EPG data downloaded from the cable 



company, satellite, pre-recorded cassettes, or DVD, etc., a bus controller 407 for 
controlling data transfer within the television portion, and a remote finder switch 
408 for the user to activate the remote finding feature. Similarly, as in the remote 
control portion, the television portion also comprises four voltage regulators 
410a,410b,410c,410d for providing currents to different components of the 
television portion. 

Figure 5 shows a preferred embodiment of a remote control 500 
according to the present invention. The remote control as shown comprises a 
display screen 5 1 0 for interfacing with the user; a plurality of buttons 5 12a,b,c,d & 
514a,b,c,d for issuing commands and/or entering data into the remote control 500; 
a stylus 516 for writing onto the screen 510 and a LED light 518 for indicating the 
communication mode currently running between the remote control and the device 
connected. As shown in the figure, the plurality of buttons comprises a group of 
four buttons 5 14a,b,c,d for moving any pointing device used in the display screen 
5 1 0. In addition, the display screen 5 10 of the preferred embodiment is connected 
to a handwriting recognition mechanism (not shown) so that the user can issue 
commands and/or enter data to the remote control 500 by writing onto the screen 
510. It should be noted that, even with the disclosure of this embodiment, many 
aspects of the present invention can still be implemented in a universal remote 
control that does not provide the display 5 10 as used by this embodiment. In other 
words, other kinds of user interface such as keyboard and push buttons can also be 
employed in the present invention. In addition, the remote control according to the 
present invention is backward compatible with the current remote control system 
such that all the current remote control fimctionality can be emulated by the present 
invention. 

In another preferred embodiment according to the present invention, 
the touch screen display is also provided with pressure sensing ability for sensing 
different handwriting stroke pressures exerted on the screen. For example, instead 
of clicking a new command button on the emulated screen, a hard pressed period 
can be programmed in the remote control for the begiiming of a new command. 
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In another preferred embodiment, instead of using a display screen 
in the remote control to interface with the user, a touch pad can be used along with 
an on-screen display ("OSD") of the television to perform similar functions. 
Specifically, the user can enter the commands/data on the touch pad of the remote 
control and the corresponding graphical user interface can be shown on the OSD of 

the television. In otherwonk, the conmiand/data inputting functions of the display 
screen of the remote control is replaced by the touchpad whereas the graphical user 
interface functions of the display screen is replaced by the OSD of the television. 
By replacing the display screen with the touch pad. the cost of the remote control 
can be tremendously reduced. In the following discussions, it should be noted that 
each and every feature using the display screen of the remote control can be 
replaced by using a touch pad along with the OSD of the television. 

The foUowings discuss different aspects of the remote control of the 
present invention. 



15 1. Bidirectional Communieatirynff 

The first aspect of the present invention relates to the means of 
communication between the remote control and the television set/set top box (and 
any other audio/video devices). As discussed above, the communication between 
the remote control and the television is preferably performed bidirectionally so that 

20 commands and data can be tranifferred fi«ely between the remote control and the 
television set. Thus, in addition to commands and data being sent from the remote 
control to the television set, commands and data can be sent back from the 
television set to the remote control. In the preferred embodiment, the 
communication is perfomied by transceivers located in the remote control and the 

25 television set. Particularly, each transceiver comprises both a transmitter and a 
receiver for sending and receiving data. This bi-directional communication feature 
of the present mvention provides extreme flexibility in the remote control design 
because the remote control not only can control the television set, the television set 
can also provide data and control signals back to the remote control in response to 

30 changes in status and/or protocols. 
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In one example of the present invention, the television set can 
forward the EPG programming data received from sateUite delivery or terrestrial 
broadcast to the remote control. The television set first receives the EPG data, and 
then forwards the data to the remote control via the bidirectional communication 
5 feature as discussed. By having the EPG programming data stored m the remote 
control memory, the remote control is able to parse and retrieve the EPG 
programming data when a user command is entered. Then the remote control can 
mterpret the TV programming data and process the command entered, and simplify 
the control of die coirespondmg AV component(s) accordingly. Detailed examples 

10 on the uses of the TV programming data are illustrated in the following sections. 
Particularly, section (4) (i.e. EPG Programming Data section) discloses methods of 
downloading the electronic programming guide (i.e. EPG programming data) to the 
remote control, and then subsequait using the EPG programming data stored in the 
remote control to handle any commands entered. In addition, using the bi- 

1 5 directional communication channel, the television set can also inform and update 
the remote control of its status and/or any new control protocols. These features 
will be discussed in detail in the following sections. 

2- Inftared/Radio Frequency rnmrnunieflriftfi 

According to another aspect of the present invention, there is 

20 provided a dual communication mode for the remote control system. Specifically, 
the television/set top box (or any other audio/video devices) and the universal 
remote control of the present inv«tion each comprises an infrared transceiver and 
a radio frequency transceiver so that the communication between the two devices 
can be performed in either the infrared or radio firequency band. Furthermore, each 

25 of these transceivers can be a bi-directional transmitting device as discussed in the 
previous paragrq»hs. 

Particularly, in response to the environment and distance between 
the remote control and the television set, the present remote control system 
automatically selects an optimal communication means (i.e. infrared 

30 communication, or radio frequency communication). It is known that each of the 
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infrared communication and the radio frequency communication modes has its own 
advantages and shortcomings. Therefore, the present invention is designed to 
alleviate the disadvantages of each means, by automatically selecting the most 
efficient communication method between the remote control and the television set. 
5 Specifically, in the preferred embodiment of the present invention, 

when the remote control is in close proximity of the television set, the infrared 
communication mode is selected in order to conserve power in the remote control. 
It should be pointed out that, by communicating using infrared signals (especially 
by complying with the IRDA standard), the remote control system of the present 

1 0 invention is able to conform to other IRDA devices such as computer peripherals, 
digital cameras, laptop computers, personal communication systems (PCS), and 
wireless modems and printers, etc. However, in some situations, infixed 
communication cannot be established due to the distance between the two devices, 
and/or some obstacles blocking the infrared transmission. In those cases, radio 

15 frequency transmission is then selected for communicating between the remote 
control and the television set (or other connected devices). It should be also noted 
that, in the preferred embodiment, the default communication mode of the remote 
control system is the infrared mode to conserve electrical energy of the remote 
control. Only if the infixed communication cannot be established between the 

20 remote control and the target device, the system will be shifted to the radio 
frequency communication mode. 

Therefore, in the preferred embodiment as shown in Figure 2, each 
of the remote control and the television set comprises an infi-ared transceiver and 
a radio fi^equency transceiver so that the remote control can conmiunicate with the 

25 television in either the infrared mode or radio frequency mode. By having two 
different transceivers in the remote control and the television set, the remote control 
system can switch between these two communication modes according to need. 

In one preferred embodiment of the present invention, a select button 
is provided in the remote control for the user to force and lock a specific 

30 communication method. This can be done by simply deactivating the proximity 
sensor. By deactivating the proximity sensor and forcing a communication mode 
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on the remote control system, the user can select a preferred and/or fixed method 
of communication between the remote control and the television set. 

3. Automatic Mode Selectio n 

Another aspect of the present invention is a method to automatically 
5 select an optimal communication mode for communication between the remote 
control and the television set (or any other audio/video devices). Under this aspect 
of the present invention, the selection between the two communication modes (i.e. 
infrared mode and radio frequency mode) is transparent to the user and is performed 
automatically in the remote control system without requiring any attention from the 
10 user. 

Figure 6a is a flow chart showing one of the preferred methods of 
determining and selecting an optimal communication mode performed by the 
remote control system according to the present mvention. At a first step (Stqp 601 ), 
both of the television and remote control are initialized to operate in both the radio 
1 5 frequency and IR mode. Then, in Step 602, the television set sends out both (1) a 
test enable signal; and (2) an IR request to the remote control. According to this 
embodiment, the test enable signal is sent by the television set using the radio 
frequency transceiver to inform the remote control of the incoming IR request. In 
the preferred embodiment, the test enable signal contains a sequence of pulses 

20 transmitted to the remote control for synchronization. In addition, the IR request 
is sent by the television set using the IR transceiver. In the preferred embodiment, 
the IR request is a predetermined sequence of data bits. When the remote control 
receives the test enable signal from the television (Step 603), it proceeds to the next 
stq). Step 604. If the remote control does not receive the test enable signal, the 

25 remote control is out of the radio frequency range of the television set so that the 
television set will repeat the initialization process again. In the next step (Step 604), 
the ronote control examines v^ether flie IR request signal is received. If the remote 
control does not receive the IR request signal, the remote control will not transmit 
any reqjonse to flie television set. On the other hand, afto- the remote control 

30 receives the IR request sequence of data bits, the remote control con^ares the 
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received IR request sequence of data bits with a reference of the sequence of data 
bits stored in the remote control (Step 60S). If the two sequences of data bits match, 
the remote control then sends an infrared acknowledgment back to the remote 
control (Step 606). On the other hand, if the two sequences of data bits do not 
S match, the remote control will not send an acknowledgment sent to the television. 

Finally, when the television receives the IR acknowledgment signal 
fiom the remote control (Step 607), the television will set the communication mode 
to the IR mode (Step 608). On the other hand, if the television does not receive any 
IR acknowledgment after a predetermined period of time, the television will 
1 0 determine that the infrared channel cannot be established and will select the radio 
frequency mode for communication between the television and the remote control 
(Step 609). 

Figure 6b is a flow chart showing another preferred method of 
selecting the mode for communications between the remote control and the 

1 5 television set First, both the television set and the remote control are initialized to 
operate in the radio frequency mode (Step 621). In this preferred method, the 
television set only sends a sequence of square pulses using the radio frequency 
transceiver to the remote control for the initialization process (Step 622). As shown 
in Figure 7, each of the square pulses has a predetermined amplitude A and time 

20 duration t. When the remote control receives the sequence of square pulses from 
the television set, the remote control compares an amplitude A' and time duration 
t' of individual square pulse received with a set of pre-stored values (i.e. A & t). 
By comparing the amplitude A' and time duration t* of the pulses received from the 
television set with the pre-stored values (i.e. A & t), the remote control can calculate 

25 the distance between the remote control and the television set (Step 624). After the 
distance between the remote control and the television set is calculated, the remote 
control can determine whether it is within the transmission range of the infrared 
transceiver (e.g. >3 meters) in Step 625. If the remote control is within the infrared 
range of the television set, the remote control will select the infrared communication 

30 mode (Step 626). Otherwise, the remote control will select the radio frequency 
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communication mode for communication between the remote control and the 
television (Step 627). 

It should be pointed out that the above-discussed mode selection 
sequence can and should be repeated regularly. For example, one of the above- 
5 mentioned mode selection methods can be performed after each keystroke entry, but 
prior to the actual data or conmiand transmission between the two devices, in order 
to ensure the most appropriate communication mode is adopted for the 
communication between the remote control and the television. 

4. EPG Programming Data 

10 Another aspect of the present invention is a method of providing 

television progranmiing guide information (e.g. the EPG data) to the remote control 
so that the remote control (1) can provide the programming guide information to the 
user using the user interface; and/or (2) can process user commands/data and then 
parse and retrieve the EPG programming data stored in the remote control for any 

IS relevant infonnation so that ^propriate controlling signals can be produced to 
activate the television sets and/or other AV devices accordingly. As discussed in 
the previous paragraphs, each of the television set and the remote control comprises 
at least one transceiver (e.g. infrared transceiver or radio frequency transceiver) for 
exchanging information between the remote control and the television set. 

20 Particularly, accbrdmg to this aspect of the present invention, the 

television set is first provided with the EPG information from the television signal 
received from either the cable company or baseband RF transmission. After the 
television set receives this infonnation, the television set transmits this information 
to the remote control through a commimication chaimel established between the 

25 television set and the remote control (e.g. infrared communication or radio 
frequency communication). After receiving this information from the television set, 
the remote control organizes and stores this information in the remote control 
memory for later use. 

For example, this EPG information may contain daily or weekly TV 

30 programming schedule and channel assignments. Preferably, each of the program 
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entries comprises the (1) TV channel number; (2) show time; (3) show name; and 
(4) synopsis of each program. Depending on the size of the remote control 
memory, the remote control can store this information of all the scheduled TV 
programming for one day, or even one week or more. By having all the EPG 
5 programming information stored in the remote control memory, the remote control 
can accommodate different modes of data entry, such as accepting command input 
using channel number, program name, or keywords. Since all related information 
of each television program is stored in the remote control memory, the channel 
number and the program name can then be retrieved by the controller of the remote 
1 0 control by parsing the EPG data stored in the remote control memory. 

For example, when requested by the user, the remote control can 
display any portion of the TV programming schedule for the night, or the week on 
its user interface. In this case, all or a portion of the program names, show times, 
and synopsis etc. can be shown for any specified time period on the user interface 
15 of the remote control. Furthermore, another feature is to allow the user to find out 
which chaimel a specific program will be showing, and at what time. 

For example, Figure 8a shows a remote control having a TV program 
named "Seinfeld" handwritten on its screen by a user. By employing handwriting 
recognition software installed in the remote control, the handwritten word 
20 "Seinfeld" can be recognized and the corresponding commands/data can be 
extracted. In the preset example as shown, the remote control first captures the 
handwritten program name "Seinfeld" and then translates it into a machine-readable 
format (e.g. ASCII data). Then, the remote control parses the EPG progranmiing 
information stored in the remote control memory and retrieves the corresponding 
programming guide information so that the programming listing for the program 
"Seinfeld" can be accessed and processed. After the corresponding information is 
obtained and processed, all or a portion of the programming guide information of 
the TV program "Seinfeld" can be listed on the user interface (e.g. touch screen). 

Figure 8b shows the remote control of the preferred embodiment 
displaying the programming guide information for the TV program "Seinfeld." 
Depending on the user interface design, all or a portion of the programming guide 
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infonnation stored in the remote control memory can be displayed on the screen. 
In the example as shown in Figure 8b, under the TV program name "Seinfeld," the 
corresponding channel number and show time are displayed on the same screen. 
In one preferred embodiment of the present invention, the user can then be 
5 prompted by the remote control to determine whether the corresponding TV 
program should be activated and shown on the television at the future show time. 
On the other hand, if the TV program Seinfeld is currently being shown on one of 
the TV channels, the remote control can send the appropriate control signals to the 
television set and switch the television set to the corresponding channel 
10 Furthermore, if selected by the user, the VCR connected to the remote control 
system can also be programmed so that the selected TV program will be recorded 
by the VCR at the future show time. 
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5. Soft Graphic al User Interface fSoft GI JD 

Another aspect of the present invention is a novel user interface 
provided by the universal remote control. This aspect of the present invention is 
illustrated by Figures 9a,9b. According to the present invention, soft graphical user 
5 interface ("Soft GUT*) can provide maximum flexibility for the user to interface 
with the remote control. The soft GUI can also provide a user-fnendly interface for 
the user to acquire control of differmt ftmctional components accessible by the 
remote control. For the remote control system as shown in Figure 2, the remote 
control can communicate and operate with all consumer electronic equipment 

1 0 having an IRDA interface. For example, the list can include stereo systans, VCR, 
DVD, computer peripherals, printers, and PCS, etc. 

Under this aspect of the present invention, the soft GUI can display 
user familiar patterns on the screen of the remote control. Particularly, the user 
familiar patterns displayed on the user interface of the remote control emulate the 

1 S control interface of any components connected to the remote control so that the user 
can issue commands by pressing the corresponding emulated buttons displayed on 
the screen. When any of the emulated buttons is pressed by the user, the remote 
control translates the user conunand to the corresponding control ftmction. Then 
the remote control sends the corresponding control signals to the specified 

20 audio/video device(s). 

For instance, Figure 9a shows a remote control of the present 
invention having the word **VCR" handwritten on its display screen. In response 
to this written command, a handwriting recognition mechanism in the user interface 
analyzes and converts the handwriting "VCR" to machine-readable ASCII data. 

25 After that, the user interface calls up the VCR controlling subroutine store in the 
remote control memory and displays the VCR control buttons (e.g. Play, Forward, 
Backward, Record, and Pause, etc.) on the rmiote control display screen as shown 
in Figure 9b. According to this aspect of the present invention, the user is then 
allowed to pick any of the VCR fimctions by pressing the corresponding button. 

30 For example, in the present example, fhe user can use a stylus to choose the "Play" 
ftmction by pointing to the corresponding button on the display screen. Then the 
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remote control converts the user input conunand to the corresponding control 
signals for activating the Play function of the VCR. 

In another example, the user can use the remote control to program 
the VCR by selecting the date, time, and channel parametere displayed on the 
5 screen. In the remote control as shown in Figure 9b, the buttons appeared on the 
display screen include day, month, and time, etc. of all the necessary parameters of 
a VCR programming command. The user can then program the VCR by simply 
pressing the corresponding buttons on the soft GUI screen of the remote control. 
Furthermore, the remote control can be designed so that when a television program 
1 0 is selected by the user, the remote control can provide the user with the television 
guide programming information of the selected television program along with this 
soft GUI screen so that the VCR can be programmed for the selected television 
program. 

Another aspect undw the soft GUI of the present invention provides 
1 5 a personalized remote control option for different usera. Under this aspect of the 
present invention, the remote control can be programmed accordmg to the 
preferences defined by different users. User-specific settings such as preferred 
channels, volume level on the television set and/or stereo set, etc. can be 
programmed and stored in the remote control memory. When this feature is 
20 activated, the remote control retrieves and executes these user-dependent settings 
according to the preference of the individual user. Furthermore, these individual 
settings can also be password protected. 

For example, when a usct activates his/her preferred settings stored 
in the remote control, the remote control can display a list of all preferred channels, 
25 and/or the past five television channels visited by the user so that the user can chose 
accordingly. Furthermore, other settings such as volume level control, balance 
control, and/or picture-in-picture controls can be similarly stored and recalled as 
user predefined settings by the user. 
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6- Expanding TV Functions 

Another aspect of the present invention is the ability to expand the 
functions of the television set. Under this aspect of the present invention, the user 
can redefine the parameters of the television set using the user interface of the 
5 remote control. Specifically, instead oftransmitting specific pre-defined commands 
(e.g. "Open PIP window for Channel 4") from the remote control to the television 
set, the remote control according to this aspect of the present invention provides a 
set of extensive control signals to the television set, or other AV devices. For 
example, the set of extensive control signals might include channel number, 
10 command of opening a PIP window, size of the PIP window, location of the PIP 
window, etc. Using these controlling signals, the television set can reformat the 
television screen accordingly. Thus, depending on the software program 
implemented in the remote control system, the remote control is able to expand the 
fimctionalities of the television set by adjusting the set of control parameters. 

Figures 10a,b,c,d show a ranote control system having a remote 
control and a television set 1020 coupled to the remote control 1010 according to 
this aspect of the present invention. 

Referring to Figure 10a, the remote control 1010 shows the channel 
number 6 on its display screai while the television set has tiie television 
20 programming set on channel 6. As shown in the figure, the display screen of the 
remote contix>l has an emulated television screen whwe ttie user can issue 
commands onto the screen. 

Referring to Figure 10b, the user has issued a PIP command on 
channel 3 to the remote control by drawing a window and then writing a "3" onto 
25 Uie emulated television screen on the remote control 1010. The command is 
recognized by ahandwritingrecognition program stored in the remote control 1010. 
Then the remote control 1010 processes the PIP command and transmits a PIP 
command on dbaimel 3 to tiie television set. It should be noted that the PIP 
command issued by the remote control to the television not only includes the 
30 conventional PIP instinction of opening a PIP window for showing channel 3. The 
command also includes the position and size of the PIP by analyzing tiie size and 
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the position of the PIP window drawn on the emulated television screen of the 
remote control. Thus, the remote control sends the following parameters to the 
television set: instruction to create a PIP window, channel number of the PIP 
window, size of the PIP window, location of the PIP window, and accompanying 
5 audio(s) etc. Then the television set opens the PIP window on the television screen 
according to these parameters. This aspect of the invention provides the user full 
control of the PIP window screen by using the remote control. 

Figure 10c shows another feature of the present invention. Under 
this aspect of the present invention, the user is able to adjust the size of the PIP 
10 screen by simply resizing the PIP window on the simulated television screen as 
shown in the remote control using standard window management techniques. As 
shown in the figure, the corresponding PIP window on the television set 1020 is 
resized accordingly when the user adjusts the size of the PIP window on the 
simulated television screen on the remote control 1 010 or, in another embodiment, 
IS on the on-screen display on the television set 1 020. 

Figure lOd shows yet another feature of this aspect of the present 
invention. Under this aspect of the present invention, the user is able to move the 
location of the PIP window screen on the television screen by simply dragging the 
emulated PIP window on the remote control 1010, or on the on-screen display on 
20 the television set 1020. As shown in the figure, the PIP window on the television 
screen is positioned by the user to a new location when the emulated PIP window 
on the remote control 1010 is dragged to a different location. In response to the 
command to reposition the PIP window screen, the remote control issues the 
correspondmg repositioning control signals to the television set by transmitting the 
new location and/or size of the PIP window as entered by the user. It should be 
noted that the same window management technique can be xised with the remote 
control under this aspect of the invention. 

It should be noted that, in the preferred embodiment according to the 
present invention, the above-mentioned window resizing and repositioning steps 
can be performed on the display screen using standard window management 
techniques. For example, the methods of resizing and repositioning Microsoft (TM) 
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windows can be similarly implemented in the remote control of the present 
invention. 

Furthermore, the user can also create more than one PIP in the 
television screen by drawing another window on the emulated television screen on 
5 the remote control 1010. The remote control 1 010 can then inform the television 
set 1020 to open another PIP screen according to the user command. 

To better accommodate this feature, the television set needs to be 
able to accept the control signals provided by the remote control and change the 
screen characteristics accordingly. For example, the television set should be able 
10 to accept the controlling parameters such as the location and the size of the PIP 
window. Using these controlling parameters, the television can basically expand 
the television functions by, for example, performing the specific PIP window 
functions, etc. The television set is therefore, preferably, a digital signal processing 
television so that the video data of the TV screen can be digitally processed and 
15 rearranged. However, implementation of this invention is not limited to a digital 
television set because an analog television set having a digital signal processing 
ability is also able to implement this feature. 

Figures 11 a, lib, 11c show another aspect of the expanding TV 
functions feature according to the present invention. 

Referring to Figure 1 la, the remote control as shown displays an 
emulated television screen and six input control buttons. In this embodiment, each 
of the six input control buttons represents a television signal input source for the 
television set. According to this aspect of the present invention, the user is allowed 
to connect any of the six input control buttons to the emulated television screen 
displayed on the remote control so that the corresponding television input signal 
will be provided to the television set accordingly. 

For example, as shown in the figure, the user can connect the video 
2 input (i.e. VD2) to the television set by drawing a line fix)m the button '*VD2" to 
the emulated television screen displayed on the remote control. By drawing the 
connection from the button **VD2" to the emulated television screen, the remote 
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control generates and sends a corresponding set of control signals to the television 
set to connect the VD2 input to the television set. 

Referring to Figure lib, the remote control as shown displays an 
emulated television screen and two buttons representing two different aspect ratios. 
5 According to this aspect of the present invention, the user can change the aspect 
ratio of the television screen by drawing a line from one of the two buttons to the 
emulated television screen on the remote control. In the example as shown in the 
figure, the aspect ratio of the television screen can be changed to 16:9 by drawing 
a line from the "16:9" button to the emulated screen displayed on the remote 

1 0 control. The aspect ratio can also be changed by tapping the corresponding button 
on the emulated screen of the remote control. Furthermore, the aspect ratio of the 
television screen can be changed by the user by simply dragging the comer of the 
emulated screen on the remote control to a new aspect ratio. This method is similar 
to the window conmiands currently used with any window computer systems. 

15 Then, the remote control will generate and send the corresponding control signals 
to the television to execute this command. 

Referring to Figure 1 Ic, the emulated television screen has an area 
for displaying closed captioning. According to this aspect of the present invention, 
the user can change the size, position, and/or characteristics of the closed captioning 

20 by simply dragging the closed captioning bar on the emulated television screen to 
other location. Then, the remote control will generate and send the corresponding 
control signals for changing the location of the closed captioning to the television 
set to execute this command. 

It should be noted that the above-mentioned examples as shown in 

25 Figures 10a,b,c, and lla,b,c demonstrate different methods of using a remote 
control to expand the controllability of the television set. According to this aspect 
of the present invention, the remote control can be programmed to perform different 
controlling functions not originally designed for the television set. By loading 
custom designed software into the remote control and the television, the 

30 functionabilities of the television set can be expanded, correspondingly. 
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8. Calibration Handshake 

Another aspect of the present invention is to allow the user interface 
of the remote control to provide the current status information of the television 
set/set top box (and other AV devices connected to the remote control). In the 
5 conventional remote control system, the remote control is usually a dumb control 
having only a unidirectional communication means which cannot receive any status 
information from the devices connected to the remote control For example, the 
remote control does not have the information of the volume level when the user is 
adjusting the volume level of the television set This infonnation (in this case, the 
1 0 volume level) can at most be provided on-screen by the television set because the 
conventional remote control does not carry any status information of the devices 
coupled. In other words, the devices connected are decoupled with the remote 
control. 

According to this aspect of the invention, the audio/video device(s) 
1 5 coupled to tiie remote control regularly updates/provides its status information to 
the remote control using the bidirectional communication channel established 
between the remote control and the device(s). After the remote contn)l receives and 
stores this status information, this information will be displayed on the user 
interface of the remote control when requested by the user. Then the user can 
control any portion of this status information by issuing corresponding commands 
to the user interface (e.g. graphically or intuitively) of the remote control. After 
processing these commands, the remote control will then transmit the corresponding 
control signal(s) to the specific audio/video device accordingly. 

Under this aspect of the invention, the remote control stores and 
updates all, or selected portions, of the status parameters of the TV or any other 
audio/video devices connected to the remote control. These parameters might 
include, but are not limited to, the volume control of the TV and the stereo 
equipment, the brightness and sharpness of the TV, the program name of the TV 
program currently being shown on the TV, the balance control of the stereo system, 
and the time remaining on the DVD player, etc. This aspect of the present invention 
is illustrated by Figures 12a,b as follows. 
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Figure 12a shows a remote control having handwriting characters "V 
TV" written onto its screen. The handwriting recognition mechanism of the user 
interface first recognizes and processes the handwriting command "V TV" and 
displays a volume control screen on the remote control. Figure 12b shows the 
5 remote control having a volume control bar displayed on the screen. It should be 
pointed out that during power-on initiation of the television, the remote control is 
provided with the current control parameters or status of the television set. Thus, 
the remote control can provide the current volume control information of the 
television set when requested by the user. In the example as shown in Figure 1 lb, 
10 the dot on the volume control bar indicates the current volume level of the 
television set. By simply dragging the dot to other position on the volume control 
bar, the remote control will execute the volume adjusting command by sending out 
a volume control signal to the television set. 

The detailed operation of the calibration handshake can be illustrated 
15 asfoUows: After the user has given a "V TV" command on the remote control, the 
remote control sends asignal through its transceiver to the television set requesting 
cuirent television status information. After receiving the request from the remote 
control, the television set provides all the volume control information to the remote 
control. The remote control then di^lays the current volume control information 
20 on its screen so that the user can control it using a stylus by dragging the dot 
representing the current volume level. The remote control then translates the user's 
command and sends the ^propriate control signals to the television for adjusting 
the volume accordingly. 

In another embodiment of the present invention, the parametos of 
25 all or a portion of the status information are stored in the remote control before any 
request from the rranote control is made. In this embodiment, each of the connected 
components regularly transmits these parameters to the remote control to be stored 
in the remote control memory. Thus the remote control can provide the current 
status information instantly when requested. 
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It should be noted that this kind of calibration handshake can be 
applied to any of the functional parameters of the television set. or any other AV 
devices connected to the remote control, such as hue. brightness, channels, etc. 

9. Passive Updating 
5 Another aspect of the present invention is the ability to passively 

update the communication protocols and/or status parameters stored in the remote 
control. For example, the updating can be performed on the remote control for the 
EPG data stored, or the communication protocols used between the remote control 
and the television set/set top box and any other AV devices. In the preferred 

10 embodimentofthepresent invention, the television set ofthe remote control system 
is capable of passively and automatically updating any protocols and status 
parameters stored in the remote control. Depending on the implementations, the 
updating can be performed regularly (e.g. daily, or weekly), or when new protocol 
and data are received by the television set/set top box and the AV devices. In the 

15 preferred embodiment according to the present invention, for example, the remote 

controlsystem can be programmed by the user on howoften the updating procedure 
is performed. Before transmitting the updated information to the remote control, 
the television set or any of the connected AV devices first checks whether the 
remote control is within the communication range. For example, in the preferred 

20 embodiment, if the data communication between the remote control and the 
television set can be performed by the inftared transceivers only, the data updating 
ofthe remote control can only be performed when the remote control and the 
television set are within the infiared transmission range. On the other hand, if the 
data communication between the remote control and the television set is pCTformed 

25 only by the radio fiequency transceivers, the data transfer for updating the remote 
control is performed when the rranote control and the television set are within the 
radio frequency transmission range. After the rq)dated data is received by the 
remote control ftom the television set, the remote control updates its EPG or control 
protocols accordingly. 
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For example, the cable company can update the EPG programming 
information weekly by sending the information through its cable lines to the 
television set every week. Specifically, this information can be embedded in the 
vertical blanking interval ("VBr') portion or MPEG sub-picture data portion of the 
5 television signal. Furthermore, individual AV device manufacturers can also update 
the protocols of the AV devices by providing, for example, video cassettes 
embedded with updated protocols to the user. After the television set receives the 
information, the television set automatically sends the information to the remote 
control for updating the EPG programming data stored in the remote control 
10 memory so that the most updated TV progranuning schedules is stored in the 
remote control. Similarly, new communication protocol(s) for conununicating with 
different AA^ component(s) can also be sent by the television set to the remote 
control for updating the corresponding protocols) currently stored in the remote 
control. 

15 In other instances, new functionalities can also be added to the 

television set by sending the corresponding control protocols of the new functions 
to the remote control. The detailed operation of adding new functionalities to the 
remote control is similar to the protocol updating as discussed above. 

Similarly, any other AV device can send its own set of the 

20 communication protocol to the remote control for passively updating or initializing 
the remote control. The advantage of this feature is to elimixiate manual updating 
and/or programming of the remote control. 

10. Lost Beacon 

Another aspect of the remote control system of the present invention 

25 is to incorporate a remote lost beacon in the remote control system. It is a conunon 
problem for the user to misplace the remote control somewhere in his or her house. 
Therefore, a remote lost beacon or a flashing LED feature is incorporated in the 
remote control system according to this aspect of the present invention. In the 
preferred embodiment, the same radio frequency transceiver in the television set can 

30 be used to provide a remote beacon signal to the remote control. When the user 
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wants to locate the remote control, the user can simply press a button on the 
television set. Then the television set will send a remote control locator signal to 
the remote control After receiving the remote control locator signal, a beeper in the 
remote control is activated and produces a sound to indicate the location of the 
5 remote control. In another embodiment, a flashing LED, instead of a beacon sound, 
can be used for indicating the location of the remote control. 

11. Voice Recognition 

Another aspect of the remote control of the present invention is to 
incorporate a voice recognition control option to the remote control. Instead of 

10 using the conventional push-button control, or the handwriting recognition 
technique as discussed in the previous paragraphs, a voice recognition mechanism 
can be implemented in the remote control for reccivmg voice information and/or 
commands from the user. There are currently various recognition mechanisms in 
the market, thus any one of the currently available voice recognition mechanisms 

15 can be implemented in the remote control according to the present invention. The 
voice recognition process is very similar to the handwriting recognition scheme as 
discussed, only with the substitution of the handwriting recognition mechanism 
with a voice recognition mechanism. The subsequent parsing of the EPG data is 
similarly implemented. 

20 It should noted that all or portion of the above-mentioned features 

can be implemented in a remote control system accordmg to the present invention. 
Figure 1 3 is provided to show the operations of a remote control system using some 
of these features according to the present invention. 

Step 1 : A command is input to the remote control by an user. For 
25 illustration purpose, assuming the command issued is a "split-screen" command. 

Step 2: The handwritten split-screen coixunand is recognized and 
translated by a handwriting recognition mechanism of the remote control to a 
nuu^hine readable command (e.g. ASCII data as shown). 
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Step 3 : A communication channel is selected by a proximity sensor 
so that the corresponding communication signals are sent through one of the two 
channels to the television set. 

Step 4: The communication signals are received by the television set 
5 using one of the two transceivers (i.e. infrared transceiver and radio frequency 
transceiver). 

Step S: The received signals are then translated again to machine 
readable data for the television set to process. 

Step 6: A central processing unit ("CPU), or a digital television 
1 0 controller ("DTC") of the television set processes the commands and transmits the 
commands to the corresponding operating subsystem through an internal bus. Each 
of the subsystems A,B>C represents a different functional component of the 
television. For example, subsystem C is for controlling various screen orientations 
(e.g. aspect ratio or PIP, etc.) of the television set 
IS Step 7: The module C receives the split-screen command from the 

CPU through an internal bus and executes the command accordingly. 

Step 8: A split screen is then displayed on the television set 
according to the command issued to the remote control. 

Step 9: After the command is executed (i.e. a split screen is 
20 displayed as requested), an acknowledgment signal is generated by the subsystem 
C and provided to the internal bus. 

Step 10: The acknowledgment signal is received by the CPU, or 
DTC connected to the internal bus. 

Step 1 1 : After a preferred communication channel is selected by the 
25 proximity sensor, the acknowledgment signal is transmitted to the remote control 
Step 12: The acknowledgment signal is received by one of the two 
transceivers of the remote control. 

Step 13: The received signal is translated and processed by a 
controller of the remote control to generate a set of control signals to the display 
30 screen of the remote control. 
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Step 14: A representation such as a acknowledgment icon is 
displayed on the remote control to signal the "split screen command has been 
executed by the television set. 

It is to be understood that while the invention has been described 
5 above in conjunction with preferred specific embodiments, the description and 
examples are intended to illustrate and not limit the scope of the invention, which 
is defined by the scope of the appended claims. 
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What is claimed is: 

1. A remote control for controlling at least one audio/video 
device, comprising: 

a receiver for receiving programming guide data from said at least 
one audio/video device; 

a remote control memory coupled to said receiver for storing the 
television programming guide data received by the receiver, and 

a user interface coupled to the remote control memory for displaying 
at least a portion of the television programming guide data when requested. 

2. The remote control according to claim 1 » wherein said at least 
one audio/video device comprises a television set, and wherein said television 
progranmiing guide data stored in the remote control memory is provided by the 
television set. 

3. The remote control according to claim 1 , said user interface 

comprising: 

a touch screen display for displaying the at least a portion of the 
television programming guide data. 

4. The remote control according to claim 1, wherein said 
television progranmiing guide data is electronic programming guide. 

5. The remote control according to claim 1 , said user interface 

comprising: 

ahandwriting recognition interface forprocessing handwriting input. 

6. The remote control according to claim 1 , said user interface 

comprising: 

a voice recognition interface for processing voice input. 
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7. The remote control according to claim 1, wherein the 
television programing data is provided to the remote control by a television. 

8. The remote control according to claim 7, wherein the 
television provides the television programming guide data to the remote control 
whenever the television progranmiing guide data is received by the television. 

9. The remote control according to claim 1 is a programmable 
remote control. 

10. A remote control system comprising: 

a television comprising a first transmitter, and a data c^turer for 
capturing television programming guide data from an input; and 

a remote control comprising a receiver for receiving the television 
5 progranmiing guide data finom the television, a remote control memory coupled to 
the receiver for storing said television programming guide data provided by the 
television, and a user interface for displaying at least a portion of the television 
programming guide data stored in the remote control memory. 

1 1 . The remote control system according to claim 10, said user 
interface of the remote control comprising a touch screen display for displaying that 
at least a portion of the television programming guide data. 

12. The remote control system according to claim 10, wherein 
said television programming guide data is electronic programming guide. 

13. The remote control system according to claim 10, said user 
interface of the remote control comprising: 

a handwriting recognition interface for processing handwriting input. 
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14. The remote control system according to claim 10, said user 
interface comprising: 

a voice recognition interface for processing voice input. 

15. The remote control according to claim 10. wherein the 
television provides the television progranmiing guide data to the remote control 
whenever the television programming guide data is received by the television. 

16. A remote control system comprising: 

a television comprising a first transceiver, a data captuier for 
capturing television programming guide data &om an input, and a display screen; 
and 

5 a remote control comprising a transceiver for receiving the television 

programming guide data from the television, a remote control memory coupled to 
the receiver for storing said television programming guide data provided by the 
television, and a controller for retrieving at least a portion of the television 
programming guide data stored in the remote control memory , said transceiver 
10 providing said at least a portion of the television programming guide data to the 
television, 

wherein said at least a portion of the television programming guide 
data is displayed by said display screen of the television. 

1 7. The remote control syston according to claim 1 6, said remote 
control further comprising a user interface, said user interface comprising a touch 
screen display for displaying said at least a portion of the television prognunming 
guide data. 

18. The remote control system according to claim 17, wherem 
said touch screen display is a LCD touch screen. 
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19. The remote control system according to claim 16, wherein 
said television programming guide data is electronic progranmung guide. 

20. The remote control system according to claim 1 7, said user 
interfece of the remote control further comprising: 

ahandwriting recognition int^^e for processing handwriting input. 

2 1 . The remote control system according to claim 1 7, said user 
interface further comprising: 

a voice recognition interfiace for processing voice input. 

22. The remote control according to claim 16, wherein the 
television provides tfie television programming guide data to the remote control 
whenever the television programming guide data is received by the television. 

23. A method for a remote control to communicate with at least 
one of a plurality of audio/video devices, wherein the remote control has a user 
inter&ce, and each of the audio/video device performs a set of functions, 
comprising: 

5 selecting at least one of the audio/video devices using the interface 

of the remote control; 

displaying a set of control buttons on said user interface of said 

remote control, each of the control buttons corresponding to at least one of the 

functions performed by the selected audio/video device; and 
1 0 activating one of the functions of the selected audio/video device by 

actuating the corresponding button on said user interface of said remote control. 

24. The method for communicating according to claim 23, said 
user interface comprising: 

a touch screen display for displaying the set of control buttons, 
wherein each of the buttons can be actuated by touch. 
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25. The method for communicating according to claim 24, 
wherein said activating step comprises: 

pushing the corresponding button on the user interface of said remote 

control; 

5 generating a set of control signals for the selected audio/video device 

of the activated function; and 

transmitting the set of control signals to the selected audio/video 
device to activate the corresponding function. 

26. The method for communicating according to claim 25, 
wherein said pushing step comprises: 

touching said user interface of said remote control. 

27. The method for communicating according to claim 25, 
wherein said pushing step comprises: 

activating a keystroke in said user interface of said remote control. 

28. The method for communicating according to claim 27, 
wherein said user interface is a pressure sensitive touch screen. 

29. The method for communicating according to claim 23, 
wherein said remote control is a universal remote control capable of adapting to 
different audio/video devices. 

30. The method for communicating according to claim 23, 
wherein said user interface of the remote control comprises: 

a handwriting recognition interface for processing handwriting input. 



31. The method for communicating according to claim 23, 
wherein said user interface comprises: 
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a voice recognition interface for processing voice input. 

32. The method for communicating according to claim 23, 
wherem said at least one audio/video device is a television, a set top box, a VCR, 
a DVD, a compact disc player, a stereo system, or home entertainment components. 

33. A method for a remote control to communicate with an 
audio/video device, said remote control comprising a user interface, and said 
audio/video device comprising aplurality of controlling components, wherein each 
of the controlling components is set at a controlUng level, comprising: 

5 selecting one of the controlling components of the audioMdeo 

device; 

transmitting the corresponding controlling level of the selected 
controlling component from the audio/video device to the remote control; 

displaying the selected controlling level on the user mterface; 
1 0 adjusting the selected controlling level usmg the user interface; and 

transmitting the adjusted controlling level from the remote control 
to the audio/video device to adjust the corresponding component of the audio/video 
device. 

34. The method according to claim 33, wherein said remote 
control comprises a user interface comprising a touch screen display. 

35. The method according to claim 33, wherein said remote 
control comprises a user interfru:e comprising a handwriting recognition 
mechanism. 



36. The metiiod according to claim 33, wherein said remote 
control comprises a user interface comprising a voice recognition mechanism. 
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37. A method for a remote control to communicate with an 
audio/video device, said remote control comprising a user interface, and said 
audio/video device comprising aplurality of controlling components, wherein each 
of the controlling components is set at a controlling level, comprising: 

5 selecting one of the controlling components of the audio/video 

device; 

transmitting the corresponding controlling level of the selected 
controlling component from the audio/video device to the remote control; 

storing the selected controlling level in a memory of the remote 

10 control; 

displaying the selected controlling level on the user inter&ce; 
adjusting the selected controlling level using the user inter&ce; and 
transmitting the adjusted controlling level to the audio/video device 
to adjust the corresponding component of the audio/video device. 

38. The method according to claim 37, wherein said remote 
control comprises a user interface comprising a touch screen display. 

39. The method according to claim 37, wherein said remote 
control comprises a user interface comprising a handwriting recognition 
mechanism. 

40. The method according to claim 37, wherein said remote 
control comprises a user interface comprising a voice recognition mechanism. 

41 . A method for a remote control to adjust the display property 
of a television screen of a television, said remote control comprising a user 
interface, comprising: 

issuing a display control command on the user interface of the 
S remote control for adjusting the display properties of the television screen; 

analyzing the display control command by the remote control; 
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translating the display control command to a set of controlling 
parameters, wherein said controlling parameters are folly controllable by the remote 
control; 

10 transmitting the controlling parameters from the remote control to 

the television; and 

displaying the television screen on the television. 

42. The method according to claim 41, wherein said display 
control command is a picture-in*picture command, and wherein said set of 
controlling parameters comprise size and location of a picture-in-picture window 
screen in the television screen. 

43. The method according to claim 42, wherein said user 
interfrice of the r^ote control comprises a display screen, and wherein said display 
screen comprises an emulated picture-in-picture window corresponding to the 
picture-in-picture window screen. 

44. A method for a remote control to create a picture-in-picture 
window screen in a television screen of a television, said remote control comprising 
a user interface, comprising: 

issuing a picture-in-picture command on the user interface of the 
5 remote control; 

analyzing the picture-in-picture command by the remote control; 

translating the picture-in-picture command to a set of controlling 
parameters, wherein said controlling parameters comprise size and location of the 
picture-in-picture window screen, and said size and location of the picture-in- 
10 picture window screen are folly controllable by the remote control; 

transmitting the controlling parameters from the remote control to 
the television; and 

creating the picture-in-picture window screen on the television 
screen according to the controlling parameters. 
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45. The method according to claim 44, wherein said user 
interface of the remote control comprises a display screen, and wherein said display 
screen comprises an emulated picture-in-picture window corresponding to the 
picture-in-picture window screen. 

46. The method according to claim 45 further comprising: 
adjusting the size of the emulated picture-in-picture window on the 

user interface of the remote control; 

analyzing the adjustment of the emulated picture-in-picture window 
5 in the remote control; 

translating the adjustment to a second set of controlling parameters, 
wherein said second set of controllmg parameters comprises an adjusted size of the 
picture-in-picture window screen; 

transmitting said second set of controlling parameters from the 
10 remote control to the television; and 

adjusting the picture-in-picture window screen on the television 
screen according to the second set of controllmg parameters. 

47. The method according to claim 46 further comprising: 
adjusting the position of the emulated picture-in-picture window on 

the user interface of the remote control; 

analyzing the adjustment of the emulated picture-in-picture window 
5 in the remote control; 

translating the adjustment to a second set of controlling parameters, 
wherein said second set of controlling parameters comprises an adjusted size of the 
picture-in-picture window screen; 

transmitting said second set of controlling parameters from the 
1 0 remote control to the television; and 

adjusting the picture-in-picture window screen on the television 
screen according to the second set of controlling parameters. 
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48. The method according to claim 45 further comprising: 

adjusting the channel of the emulated picture-in-picture window on 
the user interface of the remote control; 

analyzing the adjustment of the emulated picture-in-picture window 
S in the remote control; 

translating the adjustment to a second set of controlling parameters, 
wherein said second set of controlling parameters comprises an adjusted size of the 
picture-in-picture window screen; 

transmitting said second set of controlling parameters from the 
10 remote control to the television; and 

adjusting the picture-in-picture window screen on the television 
screen according to the second set of controlling parameters. 



49. The method according to claim 45, wherein said emulated 
picture-in-picture window display a video capture of the picture-in-picture window 
screen on the television screen. 



50. The method according to claim 45, wherein multiple picture- 
in-picture window screens can be created on the television screen. 

51. The method according to claim 44, wherein said user 
interface of the remote control comprises a handwriting recognition mechanism. 



52. The method according to claim 44, wherein said user 
interface of the remote control comprises a voice recognition mechanism. 
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